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ABSTRACT 


Cost growth is a major problem in defense systems 
acquisition. Since 1969 the DOD has underestimated the 
ultimate costs of major systems by more than 50 percent. 
Consequently, the importance of contract costs has risen 
greatly in recent years to the point that costs are now 
officially equated +o technical performance in importance. 

A body of knowledge of the structure and models of the 
behavior of contract costs and contract performance within 
DOD is desired. This paper develops a simplified 
methodology for the systematic analysis and prediction of 
cost and schedule variables from an existing data base. The 
methodology is applied to actual DOD contract data using the 


interactive computing system MINITAB. 
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Ie INTRODUCTION 


A. GENERAL OVERVIEW 

Cost growth is a major problem in defense systems 
acquisition. In recent congressional hearings, Jack Brooxs, 
Chairman of the House Government Operations Committee, 
stated: “Since 1969 the DOD has underestimated costs of all 
major systems by more than 50 percent"[ Ref. 1]. The annual 
cost growth as agreed to by the Navy for authorized 
shipbuilding in years 1971-1975, (excluding possible future 
contractor recovery on outstanding claims) rose to almost $2 
billion ~- a cost growth, for 1975 approved programs, of 
around 50 per cent [Ref. 2]. What the Brooks’ committee was 
investigating was growth within a program -- from the time 
of its initial planning estimate to actual delivery of 
production systems. There is another aspect of cost growth, 
namely the trend of increasing unit costs from one 
generation of systems to the next. As an example, the 
Secretary of the Air Force compared the respective costs of 
a World War II fighter, the P-38 at $ 200,000, and the new 
F-15, at $ 20 million. No Single factor can be identified 


aS the cause for the increased cost of military systems. 
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Investigations cf cost growth have identified inflation, 
technical changes, quantity decreases, overoptimism and 
"bhuy-ins," and reduced DOD budgets as major causes of cost 
growth and resultant increased unit cost of systems. 
Production management has been criticized for its lack of 
adequate control of contractors. Yet, even in aggregate, 


these well-known causes do not provide a complete picture. 


B. PROGRAM MANAGEMENT 

There are three basic goais in the management of every 
defense project. The foremost is technical performance. 
The Peond reascn for project management is the value of 
time. This relates notably to whether or not a system is 
available for operational readiness. It relates also to 
costs. Inflation obviously increases costs according to 
project duration. Less obvious is the fact that stretching 
out the development and production of a system usually 
reduces its potential operational life. The third basic 
objective for project management is lower system acquisition 
costs. 

A fair measure of effectiveness of the management of 
defense programs, however, 1S a comparison of each program's 
status versus the plan for that particular project. Past 


and present efforts to improve project management show great 
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improvement in meeting cost goals, particularly, “target 
cost," rather than something between target and ceiling. 
"Target cost" is the goal sought on each major program. In 
a little over two decades, many project management 
techniques have been tried - some have been rejected (like 
PERT-cost), and others have been refined. Project 
Management is now a rapidly maturing field of management. 
1. Historical Perspective 

The history of cost growth for individual defense 
(weapons) programs is abundant. Dramatic overruns on the 
F-111, the C-5A, and the SRAM missile made headlines in the 
late 1960's just at the time when public concern over the 
political, social and macroeconomic impacts of the 
Military-industrial complex had begun to surface [Ref. 3]. 

Such results in defense systems acquisitions have 
brought much criticism to the Department of Defense for the 
Way in which DOD has, in the past, managed the acquisition 
of major defense systems. Costs initially were not a major 
reason for adopting project management, as evidenced by 
early widespread use of cost-type contracts in which all or 
most of the cost risk was borne by the government. But the 
importance of costs has risen greatly in recent years to the 


point that costs are now officially equated to technical 
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performance in importance. This importance has led to many 
design-to-cost-type contracts. ~ 1S important to recognize 
the nature of the management problems involved in bringing 
into our operational inventory @ major weapons system for 
our national defense at a target cost. 
2. Risks 

The first of several categories of risk facing 
program managers concerns acquisition time for a weapon 
system, the length of which can span five to seven years, or 
sometimes longer. Reaching as we are so far into the 
future, DOD managers must effectively deal with the risks of 
making cost projections over this time Span, and ensure 
accountability for such projections. 

A second category of risk is the fact that a major 
weapon system involves nearly every field of technology. 
DOD managers must resolve the nature and amount of 
forecasted growth in the technologies that are included in a 
major system that will be operational for far into the 
future. 

The ever-changing levels of capability of our 
adversaries present another form of risk that must be 
effectively dealt with. The weapon system must also be 


designed to meet a forecasted threat derived from such 
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variables as support cf our increasing international 
commitments, obsolescence of our current weapons systems, 
Changing enemy objectives, greater weapons systems 
effectiveness, or a combination of any or all of these. Our 
Management process must be responsive to the need of 
effectively resolving the risks presented by this facet of 
this dynamic environment. 

Another category of risk that management must face 
is that, in developing and producing a weapon system that 
has not existed before, provision must be nade for the 
proper identification and timely resolution of the many 
uncertainties that experience indicates in such an effort. 
Our management process must be able to prevent or minimize 
degradation in cost, schedule, or performance of the weapon 
system as these uncertainties are resolved. 

3. DSARC 

As a means of providing management overview for 
timely decision making, the Secretary of Defense has 
established the Defense Systems Acquisition Review Council 
(DSARC). The mission of the council is to review major 
weapon system acquistion programs at appropriate milestone 
points in their life cycle. These reviews are to permit 


coordinated evaluation and deliberation among senior 
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Managers, to assure that the advice given the Secretary of 
Defense is as complete and objective as possible prior to a 
decision to proceed to the next step of the system's life 


cycle. The three basic milestone points are: 


1. When initiation of contract definition is proposed, 
2. When transition from contract definition to full-scale 
development is proposed, 


3. When transition from the development phase into 


production for service deployment 1s proposed. 


Thus, it can be seen that before a major system can progress 
through its life cycle, senior DOD managers must determine 
that satisfactcry progress has been made and is expected to 
continue, in accordance with the original and updated plans 
for accomplishing the acquisition of the systen. 

4. Cost/Schedule Control System Criteria 

The Cost/Schedule Control System Criteria (C/SCSC) 

are a set of criteria or standards that a contractor's 
Management system, whatever it may be, must meet in 
undertaking development of a major defense progran. 
Essentially what C/SCSC does 1s ensure that data provided by 


a contractor, such as his monthly cost performance report, 


is accurate and timely. Cost and schedule deviations can 
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then be traced +o their sources and action taken. There are 
some thirty-five of these criteria in the C/SCSC Joint 
Implementation Guide [Ref. 4]. They define the standards a 
contractor's management system must meet regarding 
organization, planning and budgeting, accounting, analysis, 
revision and access to data. 

c/scsSc introduced the concept of earned value which 
enables program managers in industry and the government to 
determine, with considerable accuracy, the cost status of 
their programs and supplements. They do this by comparing 
budgeted cost of work performed (BCWP) and actual cost of 
work performed (ACWP). By comparing BCWP with the budgeted 
cost of work scheduled (BCWS), they can measure actual and 
planned progress in terms of the cost reguired to come fron 
a behind-schedule position to on schedule. The Acquisition 
Management Information Division of the Office of the 
Assistant Secretary of Defense (Comptroller) analyzes BCWP, 
ACWP, and BCWP data to monitor the performance and progress 
of major defense acquisition programs [Ref. 5]. 

Several benefits result from C/SCSC. First, it 
assists the program manager in keeping within his target 
costs. Other benefits are identification of problems not 


previously recognized, the ability to trace problems to 


- 
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their source, and objective rather than subjective 


assessment of program status. 


eee COST GROWTH IN DEFENS®S CONTRACTS 

Control of costs and schedules is a dominant concern of 
defense systems acquisition management in both government 
and industry. The Comptroller General's Reports to Congress 
Since 1975 show that each year major defense systems cost 
more than their base-line estimates. 

While the costs increase, the schedules slip, and vice 
versa. The Defense Science Board reports that the time from 
Milestone 0 +o Milestone 1 has lengthened significantly from 
less than 2 years pricr to 1950 to nearly 5 years in 1974 
ipeet. «26 ]. 

These sizable cost increases and schedule slippages 
cannot be attributed to any scarcity of data. Results of an 
extensive survey conducted by the National Security 
Industrial Association (NSIA) to develop a Cost/Schedule 
Systems Compendium indicate that about 1,056,000 pages of 
cost account documentation are created each month by DOD 
contractors in order to satisfy government requirements, 
averaging 2,672 pages for each C/SCSC application [Ref. 7}. 

Despite the size of such reports, Defense Secretary 


Caspar Weinberger and Budget Director David Stockman have 
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found it necessary to assure Congress that rigorous prog ran 
management will be pursued. In a joint letter to Senate 
Budget Committee Chairman Pete Domenici, the two cabinet 
officers wrote: "Furthermore, we want to assure you that as 
part of our overall effort to constrain federal spending 
growth and eliminate the deficit by FY 1984, we pian to 
impose rigorous program management responsibilities on ail 
agencies, including the Department of Defense, to assure 


that outlays do not exceed estimates." [ Ref. 7]. 


D. NATURE OF THE PROBLEM 


It 1s apparent that several successful mechanisms are 
currently utilized to objectively monitor contractor 
performance on major defense systems at all levels in DOD. 
Yet, control of program cost growth continues to elude the 
majority of those tasked with that control, the program 
managers. There exists the possibility that, while C/SCSC 
has standardized the contractor submission of and the 
government collection of pertinent contract cost and 
schedule data, the lack of standardized utilization of this 
data by program cost managers may be a major reason that 
costs are difficult to control. Improved standardized cost 
monitoring methods could be derived for implementation such 


as done in this research. 
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Although C/SCSC and Contractor Performance Reports (CPR) 
help us in management of our major contracts, the potential 
for overruns on the non-major contracts is always present, 
and such overruns in the aggregate can easily equate to the 
growth of a major contract or two. Proper utilization of 
the tool for non-major contracts, the Cost/Schedule Status 
Report (C/SSR) , a tailored-down CPR, is necessary for 
successful control of these contracts. 

Although this paper specifically addresses the 
utilization of C/SSR data in contract cost estimation, the 
use of other contractor-generated cost and schedule data 


also needs to be studied in greater detail. 
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II. METHODOLOGY 


A. GENERAL 


Past and present program management efforts to control 
defense systems contract costs have certainly not been 
totally successful. There are instances of actual costs of 
several times the initially budgeted cost, anda time to 
initial operational capability sometimes several years 
longer than planned. A better method of forecasting costs 
is needed so that those costs can be better controlled. An 
accurate forecast of tomorrow's actuals (such as ACWP) 
compared with corresponding plans (such as BCWP) can provide 
the expected cost excess (BCWP-ACWP). Current values of 
ACWP and BCWP are standard data elements in the 
contractor-supplied cost performance reports. 

To begin to gain a clear understanding of contract cost 
forecasting, the researcher must be able to understand 
trends and relationships as they exist in the data. Second, 
he must have some means of testing hypotheses to predict 
future outcomes. The visualization can be accomplished 
through the use of graphs, equations, histograms, etc., or, 


as developed in this study, through the plotting of contract 


20 





cost data. Of the several methods available for 
quantitatively determining relationships among data, a basic 
tool for studying relations among variables is regression. 
Regression may provide the necessary coefficients to predict 
future cost and schedule outcomes. 

The methodology proposed here provides a basic framework 
within which contract costs and schedule estimates can be 
systematically reviewed, studied, updated and forecas<ed. 
The methodology is as straigntforward as possible in order 
to insure the widest possible application. Behavior of 
weapon system acquisition contracts can easily be 
assimilated within the framework provided. The methodology 
proposed by this researcher utilizes the application of the 
Rayleigh-Norden curve to contract cost data. Other 
methodological support techniques used by this reséarcher 


are scatter plots and linear regressions. 


B. RAYLEIGH-NORDEN CURVE THEORY 

Studies have indicated that there are regular patterns 
of manpower buildup and phase~out in complex projects [Ref. 
8]. This life-cycle pattern happens to follow the 
distribution formulated by Lord Rayleigh to describe other 
phenomena {Ref. 9]. Norden used the model to describs the 


guantitative behavior of the various cycles of research and 
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development projects each of which had a homogeneous 
character. Accordingly, it is appropriate to call the model 
the Rayleigh~Norden Model. 

These patterns have been described by a number of 
mathematical functions, generally in the family of 
exponential, gamma, beta, or logistic curves, by several 
researchers. In the life-cycle model, curves are fitted to 
a small number of successive "cycles" of work which occur 
during the life of a project. The cycles do not depend on 
the nature of nor the content of the project, but appear to 
be a function of the way groups of engineers and scientists 
tackle complex technological development problems. Each 
cycle (Fig. 1) can be described by a comparatively simple 
first-order differential equation, (as symbolized by the e 


above the y): 


7 = 2kKate * ; 
where 
1. y = manpower utilized during each time period, 
2. K = total cumulative manpower utilized by the end of 


the project, 


shape parameter (governing time to peak manpower), 


3. a 


a elapsed time from start of cycle. 


a2 





Percent of Total Effort 
it) 


10 





TIME 


Figure 1: Current manpower utilization curve 


Thus the cycles can be represented by a series of curves 
from the same family relating manpower used each month to 
elapsed calendar time, and differing only in relative size 
and proportions. The single parameter governing the shape 
of the curves can be thought of as a measure of the 
importance of the project (Fig. 2). Sharply peaked manpower 
buildups correspond te rush projects, while shallower curves 
are associated with stretched-out projects. 

The mathematical model of project manpower consists of 
the equation for each cycle plus a linking function which 


specifies the relative sizes and durations of the cycles and 
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+heir lags or spacing in calendar time. The linking 
relationships have beén encouragingly stable over a wide 
range of projects and a number of years [Ref. 8]. These 
results make it possible to develop projections of manpower 
and time requirements for comparable projects, given a few 
actual points on the early cycles. In addition, early 
warning of significant departures from current schedules can 
be obtained by monitoring the actual progress of a project 
against a prior projection. Since an overrun in an éarly 
cycle cascades through all the subsequent cycles, this 
‘early warning! potential of life-cycle analysis is 
applicable, particularly when making future projections. 
Further details of this model and its adaptation and 
application to defense contract cost estimation is presented 


in Chapter V. 


Gee SCATTER PLOT 

The scatter diagram provides a quick and flexible means 
for displaying variables. Because the researcher in cost 
estimation is often interested in what happens to selected 
variables over time, the time series display of a scatter 
plot is invaluable. The researcher can study a scatter 
diagram unhampered by the clutter which accompanies most 


plots. Because trends are normally the point of interest, 
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Figure 2: Life-cycle method of project control 
(Early warning technique) 

the simplified picture prcvides what the researcher needs to 
observe trends. Additionally, various relationships among 
data such as ratios, percentages, and transformations must 
be computed. In a computationally interactive node, when a 
researcher happens upon a Significant relationship, he must 
not be hampered by excessive formatting or computational 
requirements in the attempt to establish that relationship. 
The basic Simplicity cf scatter plotting and the lack of an 
individual format are proposed in this thesis as the 


appropriate choice for interactive display of data. 
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Dee REGRESSION 


The use of regression in studying reiations among 
variables is widely accepted [Ref. 10]. The application of 
regression is proposed here because the observations, i1.e., 
+he contract cost data (ACWP,target cost,BCWP) and time, 
occur Simultaneously in the nonexperimental, uncontrolled 
Situations in contractor's plants. In order to explore the 
empirical relationship between the Rayleigh-Norden model and 
selected historical contract cost data, the specific 
technique required is linear regression. 

Let Y be a given dependent variable and X a vector of K 
independent variables which combine linearly to yield Y. 


For n sample observations the model is: 


Peco oek et Dek Foo gw wl CUE UB OKCUF UU 
Q TT Zoe k k 


The error term, u, is due to two factors. First, the 
selected model is a simplification and many variables 
expected to have minor impact may be omitted. Second, even 
if a selected theoretical relationship is exact, errors of 
measurement in real observations will produce errors in the 
Observed relationship. The supposition of linearity of 
contract cost and the Rayleigh-Norden model is based ona 


transformation of both the data and the model and is 
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presented in Chapter V. The basic assumptions of the model 


anes 


1. E(u) = OQ, 
Zo. EB(ut) = o2, 
3. The X's are either nonrandom or,if random, are 


independent of u. 


The above assumptions hold for i= 1,2,..,n, where n is the 


number of observations. 


Ee SUNMARY 

An introductory explanation of Rayleigh curve theory has 
been presented in this chapter. The methodology proposed by 
this researcher utilizes the Rayleigh-Norden model and 
selected historical cost data. Further discussion describes 
the importance of scatter plots and linear regression i 
techniques in determining significant relationships between 
the data and the model. 

A descrivtion of the data base used is presented in 
Chapter III. Application of the Rayleigh-Norden model to 


the data base using an interactive computing system is 


presented in Chapter V. 
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III. STRUCTURE OF DATA BASE 

Schedule and cost data for thirty DOD contracts in the 
form of a summary of guarterly C/SSR's were obtained from a 
DOD agency. The cost items were expressed in current 
dollars as of the report dates. Contracts with start dates 
prior to January 1977, the implementation date of C/SSR, 
could not be used since the initial report period duration 
exceeded three months and thus, created a major anomaly. A 
few contracts researched were missing guarterly reports and 
linear interpolation was used by this researcher to provide 
the missing data points. 

An individual data file or worksheet, per contract, 
containing the cost and schedule items of interest, was 
constructed in the Minitab environment. Table 1 
demonstrates the column format of Minitab for one contract. 
The length of the columns of data was determined by the 
number of reports for each contract. These files served as 
the basis for all subsequent operations on and manipulations 
of the contract data. 

A general knowledge of the statistical computing systen 
Minitab is assumed in the following comments. Readers are 


referred to Ryan, Joiner and Ryan ({Ref. 11] for specific 
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format and worksheet management. Chapter IV contains a 
Peieft introduction to the format of, and details for, the 
Specific utilization of Minitab in this analysis. 

Any selected data file could be directly accessed by 
entering the command RETRIEVE 'DAT"I"', where I represented 
the contract number as coded by the researcher. The 
possible values of I were the integers 1 through 30. 

Due to the comparative nature of this study it was 
necessary to investigate the impact of inflation in a robust 
Manner. A column named 'DEFLAT* was constructed which had 
as each of its components an index applicable for the 
corresponding quarter. The selected indices shown in Table 
2 were obtained from the Bureau of Economic Analysis of the 
United States Departmert of Commerce. They represent 
seasonally adjusted implicit price deflators (base year 1972 
= 100) for DOD purchases of goods and services by category 
Emcontract, 1.e€., aircraft, missiles,and ship construction. 
See Chapter I for a discussion of the role inflation plays 
in contract cost escalation. 

Table 3 provides a list of the columns which were 
constructed in the worksheet. Unless otherwise indicated, 
the number of rows in each column is determined by the 


number of quarterly reports submitted from the start date of 
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mere cOntract through and including cycle year 1980. For 
example, row 1 pertains to cost and schedule data for the 
first quarter after the commencement of work authorized by 
mae contract. 

The data base, as constructed by this researcher, 
requires a one-time unformatted entry of contract cost and 
schedule data into computer files. Chapter IV describes the 


interactive capability of Minitab for analysis of these 


files. 
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Table 2: IMPLICIT PRICE DEFLATORS (CY 1972 = 100) 


YEAR QUARTER ATRCRAPT SISSILES SHIPS 
1976 I 116.6 112.5 146.0 
it 119.5 113.9 147.1 
e3E st 116.8 115.0 149.2 
IV 117.6 112.6 155.0 
7] I 126.3 115.6 160.2 
i 131.6 eas 165.0 
ipa 135.3 119.1 Gono 
IV 140.0 124.6 170.4 
1978 Ht 144.0 136.6 176.9 
st 144.8 133.2 178.9 
Teter 148.2 135.1 185.3 
IV 150.4 140.8 185.2 
1979 I 158.0 13365 185.1 
it 160.3 141.6 ogee 
bab 169.6 147.4 198.3 
ny 166.2 149.8 200.4 
1980 I 174.6 156.1 200.6 
it 177.4 153.9 209.4 
foyer 186.4 156.7 ZaiGe) 
IV 184.1 162.3 222.6 
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Column Name 


ACWP 


ACW/BCWP 


DEFLAT 


DTARGET 


IDACWP 


IMPDEF 


K 


LN (Y/T) 


INACWP 


MGTRES 


PERIOD 


RBCWP 


RBCWS 


mage 3: 


MINITAB DATA COLUMNS 


Contents 


Product of ratio of ACWP to BCWP 
and target cost ((ACWP/BCWP) X TARGET ) 


Actual cost of work performed 
(cumulative) 


Ratio of ACWP to BCWP 


Deflation index, deflates reported cont- 
ract cost data to 1972 constant dollars. 


DEFLAT = 100 / IMPDEF 
Deflated target cost of contract 


Incremental (quarterly) deflated actual 


cost of work performed 
Implicit price deflator (base year 1972) 


Target cost of contract, predicted by 
the model 


Natural logarithm of (Y¥/T), the pre- 


dictor variable in regression 


Incremental (quarterly) actual cost of 


work performed 


Management reserve 


Report period after commencement of 
contract authorized work 


Reported budgeted cost of work per- 


formed (cumulative) 


Reported budgeted cost of work scheduled 
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RSQUARE 


TARGET 


Za 


TSQUARE 


a7 t 


YHAT 


(Cumulative) 


Measure of the fit of the model to the 
data, coefficient of determination 


Target cess, of contract 


Quarter in which maximum INACWP occurs, 


predicted by the model 


Period squared, the explanatory var- 
lable in the regression 


Ratio of INACWP to Period 


Incremental (guarterly) actual cost of 
work performed, predicted by the model 
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te MINITASB 

The purpose of this thesis is to demcnstrate the 
application of a software cost estimation methodology to DOD 
weapon systems contract ccst data; however, the selection of 
a computer based statistical analysis system for use by this 
researcher deserves some explanation. 

Minitab is a general purpose statistical computing 
system, designed particularly for students and researchers 
who have no previous experience with computers. While it is 
fairly powerful, very flexible and easy to use, it is 
especially useful for exploring data in the early phases of 
analysis, for plotting and for regression analysis. The 
ability to manipulate columns ina single program step vice 
the looping and multifle steps required in a language such 


aS FORTRAN provides the programmer/user tremendous power. 


B. ANALYTICAL COMMANDS 

A relatively small number of Minitab commands is 
sufficient +o analyze DOD contract costs in the context of 
the methodology presented in this paper. Two principal 


commands, REGRESS and PLOT (MPLOT), in conjunction with two 
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supporting commands JOIN and PICK, provide sufficient 
computational capability while also providing a means to 
graphically present data. What follows is a user-oriented 
synopsis of sach of these commands. The analytical commands 
are the principal tools used in the study and graphical 
presentation of contract cost and schedule data. 
1. Reqress 
Syntax: REGRESS y in C using K predictors in 

eco g G 
Parameters: 

i K ~- The number cf predictor variables 

Ze C - the column numbers of the y variables and the kK 


predictor variables 


Description : In its basic capability to do linear 
regression analysis, REGRESS relates the dependent variabie, 
Y, to the independent variables, X's. Basic output consists 
of the regression sats standard deviation of the 
regression coefficients, r-square, r-sguare adjusted, ANOVA 
table and Durbin-Watson statistic. Additionally, if 
specified in the REGRESS command, residuals, predictors 
(fitted Y values), and the regression coefficients may be 
stored in user defined columns for use in analysis. This 


Optional storage allows for simplified plotting of the usual 
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plots of residuals versus the predicted values, residuals 
versus each X variable and residuals versus time order. An 
example of the results of REGRESS is presented in Figure 3, 
while the definitions of the REGRESS output statistics 
appear in Table 4. 
2. Plot 
Syntax : PLOT y in C vs & in Cc 
Parameters ; 
1. WIDTH - Controls the horizontal size of the display 
(30-100 spaces). (Default = 50 spaces) 

2. HEIGHT - Controls the vertical size of the display 
(15-400 lines), (Default = approximately one-half the width) 
wee DTH amd HEIGHT - Controls both the horizontal and 
vertical size of the display with single command. (Default = 


50 spaces wide, 25 lines high) 


Description : PLOT produces a two dimensional scatter plot 
of the data contained in the specified columns. The pairs 
(x,y) are plotted with the symbol '®' unless two or nore 
points fall on the same spot. In this case a count of 
points falling on the same spot is given. A ‘'t#* is given i 
the count is over nine (9). Figure 4 displays a sample 
output of PLOT. Divisions on the axes of the plot are 


explicitly printed. 
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THE REGRESSION EQUATION IS 


Y = Pee. = 0.0503 xX 
ST. DEV. T-RATIO = 
COLUMN CORPEL erent OF COEF. COEF/S.D. 
= 2.3162 0.2428 9.54 
X1 TSQUARE =0,05085 0.01735 =D 9 0 
ome ST. DEV. OF Y ABOUT REGRESSION LINE 5 
Se- 0.3355 
Meo 5= 2) = 3 DEGREES OF FREEDOM 
R~SQUARED = 73.7 PERCENT 
R~SQUARED = 65.0 PERCENT, ADJUSTED FOR D.F. 
ANALYSIS OF VARIANCE 
DUE TO DF SS MS=SS/DF 
REGRESSION 1 0.9480 0.9480 
RESIDUAL 3 0.3377 0.1126 
TOTAL 4 1.2857 
DURBIN-WATSON STATISTIC = 1.96 


Figure 3: 


Sample Results of "REGRESS Command 


38 





Papper dt: Detiniticns of Terms” in ‘REGRESS Results 


TERS 


Analysis of 


Variance 


Degrees of freedom 


Durbin-Watson 
statistic 
F-tests 


Mean square (MS) 


Predicted y- value 


DEFINITION 


The analysis of variance table gives 
the following sums of Squares (SS). 
Let n = number of observations. The 
TOTAL SS = SUM((Y-Ybar)-squared), and 
has n-1 degrees of freedom. The SS 
DUE TO REGRESSION is SUM ((Yhat-Ybar) 
-~squared)where Yhat is the predicted 
value of Y. The SS RESIDUAL is SUM 
((Y¥-Yhat)-squared). The last column 
gives the mean squares which are 


useful for various F-tests. 


The number of degrees of freedom for 
the sum of sguared residuals is the 
number of observations minus the 
number of coefficients in the regress- 
10n equation. This degrees of freedom 
is used in t-tests and confidence 
intervals and in F-tests. Each 
regression coefficient has 1 degree 

of freedom associated with it. 


Used to test for autocorrelation in 
the data. 

F-tests for the significance of reg- 
ression, etc, are easily carried out 
using the MS values in the analysis 


of variance tables. 


Sum of sguares divided by its deg- 
rees of freedon. 


The value produced by substituting 
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Regression equation 


Residual 


R-squared 


Standard deviation 


of coefficient 


Standard deviation 
of predicted y 
values 


Standard deviation 
of y about 
regression line 


the x-value(s) into the fitted reg- 
ression equation. 


The equation found by the REGRESS 
command which fits the data best, 
according to the least squares cri- 


+erion. 


The difference between the observed 
and predicted y value, i.e., y - (b0 
tA A laete. 4 asi )ivs 


also called the error or deviation. 


This difference is 


A measure of how well the regression 
equation fits the data, with 100% in- 
dicating a perfect fit. Defined by 

100(SS due to regression)/(SS total). 


Since the coefficients are determined 
by the data, they are random variables. 
The estimate of their standard devia- 
tion is printed in the table of coef- 


ficients. 


Since the fitted regression equation 
is determined by the data, the pred- 
icted values are random variables. 
The standard deviation of these is 
printed out as an indication of un- 
certainty and for use in forming 


prediction and confidence intervals. 


It is 
defined by s = sqrt(MS(error)). The 


This is an estimate of sigma. 
degrees of freedom associated with s 


is the same as for SS(error), n-p, 
where p is the number of coefficients 


4Q 





in the eguation. 


Tests Reses OL Slgniticance of the coer- 
ficients are based on the t-ratio in 
the table of coefficients. fF-tests 
for the significance of regression, 
etc., Can be done easily by using MS 
values in the analysis of variance 
tables. 


f=ratio The ratio coefficient/(est. st. dev. 
of coef.) 1s used as a test statistic 
for testing the hypothesis that the 
true (population) coefficient is 0. 


MPLOT produces multiple plcets on the same axes. The first 
pair of columns are plotted with the symbol ‘A’ , the second 
pair with ‘'B* and so on. If several points fall on the same 


Spot, a count is given as in PLOT. An example of the 


results of MPLOT is displayed in Figure 5. 


C. SUPPORTING COMMANDS 


The supporting commands provide greater flexibility for 
data manipulation and format for interactive output. 
1. Join 
Syntax: JOIN E to the bottom of E ( to the botton 
of E,...,tO E) put into C. (E denotes either a stored 


constant, a number, or a stored column) 


Description : The command JOIN is used to create a new data 
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peo: C9 vs cl 
INACWP 
19.0 


9.0+ ma 


0.0 3.0 6.0 9.0 12.0 15.0 
PERIOD 


Figure 4: Sample Results of ‘PLOT Command 
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oot c17 vs ci6 and c19 vs cl16 


n(y/t 
eA 
as = ACTUAL 
= B = PREDICTED 
2-40+ 
- B 
x B 
2. 10+ 
1.80+ 
- A 
= A 
=~ A 
1.50+ 
= B 
1.204 
$e m= $a $ ee enn $— 22 - = -- $n + 
0.0 4.d 8.0 12.9 0 20.90 
TSQUARE 


Figure 5: Sample Results of ‘'MPLOT’ Command 


column consisting of E augmented by E1, E2, .., EN. Since 
Eis defined to be either a number(scalar) or a 
column (vector), conformability in the usual sense is not 
necessary. The command JOIN provides an ability to readily 
and handily increase the number of data points in a column 
(Fig. 6) to be regressed by REGRESS and/or plotted by PLOT 
oe MPLOT. 

Ze ~ Back 


Syueat meme tan fows K thru K of C, put into C 


Description : The command PICK is used to create a new data 
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column, of 2qual or shorter length, from an existing data 
column. It provides flexibility to the interactive user in 
regressing and/or plotting partial columns of data without 
the hardship of re-entering the interesting data by 


conventional methods. 


Dee SUMMARY 


This chapter presented detailed descriptions and results 
of Minitab commands extensively used in this research. 
REGRESS describes the relationship between nodelled 
independent and dependent variable data columns. PLOT and 
MPLOT produce desired scatter plots of data columns. PICK 
and JOIN are useful for the necessary manipulation of the 


data. 
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mint ¢c23 c24 

OLUMN YINTCEPT SuOrE 
COUNT 10 10 
ROW 

1 1.00000 9.00000 
2 2.24182 -0 .04105 
3 2. 16964 -0.03435 
4 2.05769 -0.02630 
5 1.97806 -0.02174 
6 1.90445 -0 .01830 
7 1. 85665 -0.01644 
8 1.83264 ~0.01566 
Q 1.76162 -0.01366 
10 1.69895 -0.01214 


fweomn C23 2.3162,c23 


join c24 -0.05035,c¢c24 


maunt C23 c24 


COLUMN YINTCEPT SLOPE 
COUNT 11 11 
ROW 
1 2. 31620 -0 .05035 
22 1.00000 9.00000 
3 2. 24182 -0.04105 
4 2. 16964 -0.03435 
5 2.05769 -0 .02630 
6 1.97806 -0.02174 
7 1.90445 -0 .01830 
8 1. 85665 -0.01644 
9 1.83264 -0.01566 
10 1.76162 -0.01366 
11 1.69895 -0.01214 
Figure 6: RESULTS OF 
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V. DATA ANALYSIS 

Illustrated in this chapter is the adaptation and 
application of the proposed methodology described in Chapter 
II to actual cost data of various defense procurement 
Goncracts. 

In the initial stages of investigation, the researcher 
extensively applied the Minitab command PLOT to the raw 
contract data, specifically INACWP versus PERIOD, in an 
effort to ascertain whether or not these variables of 
interest visually displayed characteristics of the 
Rayleigh-Norden curve. Visual inspection of such plots 
(sample in Figure 7) and comparison of these with Norden's 
curve as displayed in Chapter II, Figure 1, revealed graphic 
Similarity, raising the possibility that the Rayleigh-Norden 
model could be applicable to this problem area. 

Only three of the thirty contracts comprising the data 
base were suitable for investigation by the researcher for 
application to the proposed methodology due to some apparent 
irregularities in cost reporting, as cited in Chapter III. 
However, this sample should provide an insight into the ease 


with which relationships can be ascertained and examined 


using a Simple interactive methodology. 
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prot c9 vs ctl 
INACWP 
io. OF = 


9.0+ ‘ 


0.0 3.0 6.0 9.0 12.0 15.0 
PERIOD 


Figure 7: INACWP VERSUS PERIOD 


A. THE ADAPTED MODEL 

The Rayleigh-Norden equation is adapted for use by 
Substituting contract cost data and terminology for the 
variables Norden utilized in his software development 
research efforts. The resultant eguation is: 


-ate 


y = 2Kate , where 
1. y = ACWP during each report period (INACWP), 
2. K = total cumulative contract cost (target-cost) by 


the end of the project, 


WW 

e 

fp 
i 


Shape parameter (governing time to peak ACWP), and 


yoy 

e 

(+ 
hi 


elapsed time from start of contract. 
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Bye substituting OF = 1/2a, where t is time of peak ACWP, 
yields the following form of above equation: 


° ~t-/2te 
y= RAGS des 


B. TRANSFORMATION OF THE MODEL 

The simplest way to follow and track the time varying 
behavior of a contract is to plot the INACWP at any instant 
in time, as shown in Figure 7. Using this data stream 
transforms the problem into on of time series analysis. The 
time series problem is most easily solved by turning the 
characteristic Rayleigh behavior into a straight line. One 
can fit the actual contract cost data to get a revised 
estimate of future resource consumption: target cost, 
contract duration, future ACWP, and their tolerances. The 
results of transforming the Rayleigh-Norden curve into a 
linear form is illustrated in Figure 8. The equations 
underlying this natural logarithmic transformation are 


Summarized as follows: 


y = (K/t*)te d, 
d 
Dividing by t yields 
° ein 
y/t = CAE) 2 d 
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piot cl? vs cl6 


LN (Y/T 
B30 ) 
— # 
2. 40+ 
Ts 
1.60+ * 
: “ 
- wt 
0. 80+ 
Fea x 4 
- te 
- bs 
- k 
Q0.0 + 
- x 
= w 
= aos 
$e a a tp nn a a tp oe nn a pn et = oo = = = = = + 
0. uO. 80. 120. 160. 200 


TSQUARE. 
Figure 8: LINEAR FORM OF RAYLEIGH~NORDEN CURVE 
( Ln (Y¥Y/T) versus TIME Squared ) 
and taking natural logarithims yields 
Ln (y/t) = Ln (K/t2) + (-1/2t2)t2 , 


which is the familiar linear fora 
Y = A + BX, 


but expressed as a function of té@. 


The ease with which column arithmetic can be performed 
in Minitab was exploited in transforming the contract data 


for later use in regression. The resultant transformed data 
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representing a helicopter weapons system contract is 


displayed in Table 5. 


Table 5: 


Beant cl c9 c14 cl6 cl? 


TRANSFORMED DATA 


PERIOD NACHE Léz TSQUARE LN (£27) 

1 14.6000 14.6000 1. 2.68102 

2 11.7000 5.8500 4. 1.76644 

3 16.0000 oe ces or 1.67398 

4 18.9000 4.7250 16. 1355207 

5 15.6000 3.1200 25% 1.13783 

6 14.8000 2.4667 36. 0.90287 

7 13.6000 1.9429 49. 0.66416 

8 16.4000 2.0500 64. 0.71784 

9 15.0000 1.6667 Salle 0.51083 

10 14.8000 1.4800 100. 0.39204 

11 12.2000 1.1097 121. 0.10354 

12 9.0000 0.7500 144. - 0.28768 

ie 11.7000 0.9000 169. -0.10536 

14 10.9000 0.7786 196 =Om2o1029 
C. CONTRACT CONTROL AND ESTIMATION 


One can learn the characteristics of the adapted 
Rayleigh-Norden curve for a particular contract by analyzing 
early INACWP cost data. Then subsequent data can be used to 
predict a new curve, which may differ from the one 


Originally projected. This gives a forecast of final cost 
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which can warn of cost growth and change in other contract 
management parameters. 

As work proceeds during the contract, uncertainty about 
+he management parameters decreases. At the end of the 
project, all the parameters are precisely known, but this 
is, of course, too late to be useful for estimating or 
control purposes. However, use of the early and subsequent 
forecasts can approximate the final actual target cost 
figure long before the end of the contract. 

To determine the early characteristics of the contract, 
the first four reported INACWP values in transformed format 
were linearly analyzed. This selection of data (Table 6) is 
facilitated by using the PICK command described in Chapter 
IV, and represents one year's progression of the contract. 
Regressing Ln(y/t) on t2 using the command REGRESS provides 
information which can be used for contract control and 
estimation. From the regression results in Figure 9, the 
Slope (X-coefficient) can be used to compute the period in 
which maximum INACWP occurs, to: The intercept, Ln(K/t 2), 
given the value of t~ just obtained, can be used to 
determine the estimated value of total cumulative contract 
cost, K, and both the slope and intercept can be used to 


project next quarter's INACWP, now defined as Yhat. A 
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graphic representation of the regression results is 


displayed in Figure 10. 


The algebra supporting the above discussion is as 


follows: 


To solve for 4 begin with 
Slope = maces = B, 


taking reciprocals yields 


-2t2 = 1/8, 
d 


dividing by -2 yields 


te = -1/2B, 
d 


and taking the square root gives 
oe = SQRT (-1/2B). 


To solve for K, begin with 


; Intercept = mage = A, 


taking the exponential yields 


exp Set = exp (A), 


solving yields 


A 
Ee = e, 


and multiplying by gives 


DZ 





To solve for Yhat, begin with 
Ln(Yhat/t) = A + Bt2, 
taking the exponential yields 


(A + Bt2) 
Yhat/t = e, 


and multiplying by t gives 


(A + Bt2) 
Yhat = te - 


The resultant important management parameter values for this 
data are: 

i. oe = 2.85761 quarters 

2. K = $ 88.038 million 

3. Yhat = $ 11.6638 million (next quarter's INAWCP) 

Recall that these parameter values are based on data for 

the first year of the contract. A quarter later, upon 
receipt of the next ccntractor-supplied C/SSR report, the 
actual data points are available and are added to the data 
from Table 6 to yield Table 7. An additional dot is added 
to the graph in Figure 10 (Fig. 11) and the best straight 
line is again fitted. Linear regression statistics (Fig. 


12) reveal that both the intercept and the slope have 
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hawberos ) ENPUT DATA FOR INITIAL ESTINATE 


PERIOD INACWP Wie TSQUARE LN (Y/T) 
1 14.6000 14.6000 Ts 2.68102 
2 11.7000 5.8500 4. 1.76644 
3 16 .0000 5~3333 9. 1.67398 
4 18.9000 4.7250 16. o> 20 / 


changed, thus resulti¥ng in new values of the contract 
Management parameters: 

1. t, = 3.15127 quarters 

2. K = $ 100.666 million 


3. Yhat = $ 9.9280 million. 
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regress y in c17 using 1 predictor in c16, (store st. 
residuals in c18 (pred y in c19(coef in c20))) 


THE REGRESSION EQUATION IS 


Y= cee - 00612 X1 
of. Dany. T-RATIO = 
COLUMN COEPFICIENT OF COEF. COEF/S.D. 
a Ze 73 0.3284 7.24 
X1 C16 -0.06123 0.03491 lett) 


THE ST. DEV. OF Y ABOUT REGRESSION LINE IS 
S = 0.3965 
WITH ( Y- 2) = 2 DEGREES OF FREEDOM 


60.6 PERCENT 
40.9 PERCENT, ADJUSTED FOR D.F. 


R-SQU ARED 
R~SQUARED 


ANALYSIS OF VARIANCE 


DUE TO DF 35 MS=SS/DF 
REGRESSION 1 0.4837 0.4837 
RESIDUAL 2 0.31744 0.1572 
TOTAL 3 0.7980 


Figure 9: REGRESSION STATISTICAL RESULTS 
(ONE YEAR INTO CONTRACT) 


aD 





eee /<) c17 vs c16 and c19 vs cl6 


a 
A = ACTUAL 
- B = PREDICTED 
2-40+ 
- B 
i B 
2.10+ 
1.80+ 
= A 
- A 
A 
1.504 
- B 
1.20+ 
$ eee $e ne == ham a a fae et ee + 
0.0 4.Q 8.0 12.0 20.0 
TSQUARE 


Figure 10: GRAPHICAL RESULTS OF REGRESSION AFTER 4&4 QUARTERS 


Table 7: INPUT DATA AFTER 5 QUARTERS INTO CONTRACT 


PERIOD INACWP Y/T TSQUARE LN (Y/T) 
1 14.6000 14.6000 1. 2-68102 
2 11.7000 5.8500 4. 1.76644 
3 16.0000 9223333 9. 1.67398 
- 18.9000 4.7250 16. 1.55287 
a 15.6000 3.1200 256 1.13783 


56 





eat VS C16 AND C19 VS C16 


to 
ut 
UO b> 


0.0 6.0 12.0 18.0 24.0 30.0 
TSQUARE 


Figure 11: GRAPHICAL RESULTS OF REGRESSION AFTER 5 QUARTERS 
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THE REGRESSION EQUATION IS 


Y = 2.32 -0.0503 X1 
ST. DEV. T-RATIO = 
COLUMN COEFFICIENT OF COEF. COEF/SS.D. 
== 2.3162 0.2428 9.54 
X1 TSQUARE -0.05035 0.01735 aoe) O 


THE ST. DEV. OF Y ABOUT REGRESSION LINE IS 


se 0.3355 

WITH ( 5- 2) = 3 DEGREES OF FREEDOM 
R-SQUARED = 73.7 PERCENT 

R-SQUARED = 65.0 PERCENT, ADJUSTED FOR D.F. 


ANALYSIS OF VARIANCE 


DUE TO DF =o MS=SS/DF 
REGRESSION 1 0.9480 0.9480 
RESIDUAL 3 0.3377 0.1126 
TOTAL “ T2357 


DURBIN-WATSON STATISTIC = 1.96 


Figure 12: REGRESSION RESULTS AFTER 5 QUARTERS 


D. ANALYSIS OF RESULTS 

This technique, ccntinued iteratively for fourteen 
guarters reveals rather startling results. Using the output 
DATA IN TABLE 8 (RSQUARE, PREDICTED AND ACTUAL COST 


parameters), the regression results on this data (Fig. 13), 
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and the plot in Figure 14, this researcher asserts the 
x 
Eollowing: 

1. AS expected, the initially projected contract 
parameters will differ from the actual values; however, the 
differences are not usually significant, 

2. Control usually gets better as each new data point is 
added, because knowledge about system behavior becomes more 
precise as the project proceeds, 

3. The technique is adaptive - it indicates present 
status of the contract, 


4. The technique is predictive - it tells where the 


Sentract 1S going. 


These assertions by this researcher are 
Supported primarily by the less than one percent error 
between the projected target value, (K), and the actual 
TARGET after thirteen quarters of application of this 
methodology (Table 7). At this point in time of the 
contract, elghty-six percent of the targeted cost ($ 213.3 
million) , had been expended, (represented by ACWP, $ 184.3 
million). Eight quarters remained until the estimated 
contract completion date. While a universally acceptable 
definition of the term tearly', as it relates to contract 


control, could be subject to a great deal of debate by many, 
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this researcher claims that reasonably accurate knowledge 
about contract parameters when less than two-thirds through 
the length of the contract can be classified as ‘early’. It 
is acknowledged that it may then be hard to change the final 


results by more than a small amount, however. 


Table 8: OUTPUT DATA 


ment Cl c6 c33 c9 ¢29 c31 


PERIOD R-SQUARE TARGET K INACWP YHAT TD 

1 0.0 14.6000 

2 208.000 11.7000 

3 214.100 16.0000 

w 60.6 210.300 88.038 18.9000 2.85761 
5 73.7 208 .900 100.666 15.6000 11.6638 Sea 127 
6 m9. 205.700 114.610 14.8000 9.9280 3.48985 
7 82.5 206.000 127.457 13.6000 8.8117 3.81550 
8 PTs 212.500 148.836 16.4000 at > 4.36046 
9 76.9 212.300 166.284 15.0000 Ssa7l7 4.79618 
10 76.5 212.000 183.510 14.8000 Ss2239 9322739 
11 a323 214.500 194.688 12.2000 8.0712 5.51448 
2 83.8 211.500 199.622 9.0000 7.1985 2105132 
13 82.2 213.300 213.036 11.7000 Det Oont 6.04916 
14 81.5 225.400 Zizi oo 10.9000 5.5987 6.41681 
15 Deo 
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meeeess C15 1 ¢13, (c18(c19 (c20) ) ) 


THE REGRESSION EQUATION IS 


Y = 1.70 -0.0121 X1 
See EV. T-RATIO = 
COLUMN COEPrTICPENT OF COEF. COEF/S.D. 
= 1.6989 0.1595 10.65 
X1 ei3 ~0.012143 0.001670 esa) 


THE ST. DEV. OF Y ABOUT REGRESSION LINE IS 
S = 0.3885 
WITH ( 14- 2) = 12 DEGREES OF FREEDOM 


81.5 PERCENT 
80.0 PERCENT, ADJUSTED FOR D.F. 


R~SQUARED 
R-SQU ARED 


ANALYSIS OF VARIANCE 


DUE TO DF Ss MS=SS/DF 
REGRESSION ts Wego 113 7.9773 
RESIDUAL 2 1.8115 0.1510 
TOTAL 13 9.7888 
X1 o PRED. Y ST.DEV. 
ROW C13 C15 VALUE PRED. Y RESIDUAL 
1 1 2.681 1.687 0.158 0.994 
14 196 — 06250 ~0.681 Oace | 0.431 


DURBIN-WATSON STATISTIC = 0.68 


Figure 13: REGRESSION RESULTS AFTER 14 QUARTERS 
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eoe ev ¥S C13 and ci9 vs ci13 


ERE 


1.80+ A 
=" BB2 A A = ACTUAL 
= BB : B = PREDICTED 
~ A 
0.90+ B 
~ AB 
= A B 
- A 
= 2 
0.0 + B 
- A A 
= A B 
= B 
-.90+ 
$-<-<------- te wm me en pt a ne a te ee + ” 
oO. 50 100. 150. 200 


Figure 14: REGRESSION RESULTS AFTER 14 QUARTERS 
(Graphical Presentation) 


The use of r-square as a measure of the explanatory 
power of the regression, in particular, as a measure of how 
well the estimated model fits the available data, is an 
acceptable standard in statistics [Ref. 12]. R-square 
values tend to be high when using large sample sizes of 
time-series data, and a value of ninety percent or higher is 
usually expected [{Ref. 10]. While the resultant R-SQUARE 
value after thirteen guarters (a relatively small sample 
size), is 82.2 percent (Table 8), short of the expected 
value, the difference is not great enough to discard this 


model from consideration for applicability. 
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The proposed model falls short in its forecast of Yhat, 
the next quarter's INACWP. A comparison of the two columns 
in Table 8 reveals the differences.However, the predicted 
values are within the 95 percent confidence interval for 
actual INACWP values. 

The parameter t, projects the period in which the INACWP 
is maximum. After fourteen quarters, the value of be. is 
6.41681 guarters. However, the actual maximum INACWP 
occurred in quarter four. 

The Durbin-Watson statistic tests for the presence of 
autocorrelation, in which the stochastic disturbance terms 
(u) of the regression are not independent of one another. 
The problem of autocorrelation is a frequent, if not 
typical, one when uSing time series data. The stochastic 
disturbance term at one observation wili be related to the 
disturbance term of nearby observations. The value of the 
Durbin-Watson statistic (Fig. 13) is 0.68 and indicates the 
presence of first-order autocorrelation in this model [Ref. 
10]. Therefore, the least-square estimators, the regression 
coefficients, are linear, unbiased, and consistent. 

However, the usual t-test of significance of coefficients 
and the F-tests of the significance of the entire regression 


Will, in general, be biased. While there are possible 
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methods to treat first-order autocorrelation, such treatment 


methods were not pursued in this paper.Methods are available 


eae, Ref. 10 j. 


fee CN FLAT ION 


Because its exact values are unknown, inflation degrades 
she efforts of contract management to control project 
Outcomes. An attempt was made to investigate whether or not 
the proposed methodology could infer a degree of measurement 
of the impact of inflationary uncertainty. 

To measure the impact of inflation, the proposed 
methodology was applied to the data used in the previous 
section after deflation to constant 1972 dollars (Table 9). 
The hypothesized standard of measure of inflation impact is 
that an improved model fit (increase in r-square) and 
improved contract management parameter values (when compared 
to deflated actual values) ,would imply a negative impact of 
inflation on control and estimation. 

The results of the application of the proposed 
methodology are displayed in Table 10, Figure 15, and Figure 
16. While r-square slightly increased in value from 81.5 
percent (Table 8) to 82.7 percent(Table 10) after fourteen 
quarters, the average differences in IDACWP and DYHAT are 


less than the average differences in INACWP and YHAT. DK, 
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the estimated parameter of primary concern, reaches the 
actual TARGET value after twelve quarters but thereafter, 
continues to increase through the fourteenth quarter. Dt is 
6.10847 quarters compared to the actual maximum IDACWP 
occurring in the fourth quarter. The Durbin-Watson 
statistic value of 0.66 (Fig. 16) indicates the presence of 
first-order autocorrelation. 

The improved fit of the model to the data, and the 
improved estimates of the parameter values(excepting target 
cost), demonstrate a potential capability of this 


methodology to effectively measure the impact of inflation. 
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Table 9: 


pent C10 c11 ¢ct2 ¢c52 ¢c51 


PERIOD 


Owes A WN & WW HH = 


WO 


11 
12 
1S 
14 


IMPDEFP 


131.600 
135.300 
140.000 
144.000 
144.800 
148.200 
150.400 
147.000 
158.000 
16 0. 300 
169.600 
166.200 
163.700 
174.700 


DEFLAT 


0.759878 
0. 739098 
0.714286 
0.694444 
0.690608 
0.674764 
0.664894 
0.680272 
0.632911 
0.623830 
0.589623 
0.601685 
0.610874 
0.572410 
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IDACWP 


11.0942 
8.6474 
11.4286 
1S 1250 
10.7735 
9.9865 
9.0426 
17.1565 
9.4937 
Dee Le 
7.1934 
524152 
7.1472 
6423595 


DEFLATED INPUT VALUES 


DACWP 


11.094 
19.438 
30.214 
42.500 
53.039 
61.808 
69.947 
82.721 
86.456 
94.448 
96.462 
103. 851 
112.584 
111.734 


DIARGET 


0.0 
133.732 
152.929 
146.042 
144.268 
1383799 
136.968 
144,558 
134.367 
1324252 
126.474 
127.256 
130.299 
129.021 





Table 10: 


OUTPUT DATA 


Beant ¢c34 c51 c44 c12 ¢50 c38 . 


PERIOD RSQUARE 


OoOnwAy nA WM £& WW BR = 


ab eklkRDlleeeeeedk 
mm £& WwW HY =| OO 0 


64.1000 
7365000 
80.5000 
83.2000 
77.2000 
77.8000 
77.9000 
81.2000 
85.1000 
83.1000 
82.7000 


DTARGET 


0.0 
loa. 1352 
152.929 
146.042 
144.268 
138.799 
136.968 
144.558 
134.367 
132. 252 
126.474 
127.256 
130.299 
A290 


DK 


60.851 
70.111 
79.510 
B97 
102. 761 
113.025 
122.594 
129.436 
132.913 
140.690 
146.841 
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(DEFLATED) 


IDACWP 


11.0942 
8.6474 
11.4286 
13.1250 
10.7735 
9.9865 
9.0426 
11.1565 
9.4937 
Se2s2t 
7.1934 
524152 
7.1472 
6.2393 


DYHAT 


7.62886 
6.46860 
5.64129 
4.89319 
5- 36139 
5. 06618 
4.79655 
4.11282 
3.24836 
3. 12383 
2.89520 


DTD8 


2212976 
3.03449 
3.303557 
3.68105 
4.22577 
4.61266 
5-00000 
5.24142 
5.39164 
5.77350 
6.10847 





regress y c43 1 c&2, (c44 (c45 (c46)) ) 


THE REGRESSION EQUATION IS 


Y = 1.37 -0.0134 x1 
ST. DEV. T-RATIO = 
COLUMN COEFFICIENT OF COEF. COEP/S.D. 
-- 1.3723 0. 1688 8.13 
x1 T2 -0. 013403 0.001768 -7.58 
THE ST. DEV. OF Y ABOUT REGRESSION LINE IS 
S = 0.4112 
WITH ( 14- 2) = 12 DEGREES OF PREEDOM 
R-SQUARED = 82.7 PERCENT 
R-SQUARED = 81.3 PERCENT, ADJUSTED POR D.F. 
ANALYSIS OF VARIANCE 
DUE TO DF Ss MS=SS/DP 
REGRESSION 1 9.7183 9.7183 
RESIDUAL 12 2.0287 0.1691 
TOTAL 13 11.7471 
X1 ¥ PRED. Y ST.DEV. 
ROW T2  LN(DY/T) VALUE PRED. Y RESIDUAL 
1 1 2.406 1.359 0.167 1.047 
14 196 -0. 808 -1.255 0.244 0.446 


DURBIN-WATSON STATISTIC = 0.66 


Pigure 15: 
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REGRESSION RESULTS (DEFLATED) 





mplot c43 vs c4¥2 and c45 vs c&2 


LN (DY/T) 
3.0+ 
- A 
2.0+F 
- A = ACTUAL 
~ B2A B = PREDICTED 
= B2 
1.0+ B 
= RS S&B 
= A B 
~ A 
= A B 
0.0+ A Z 
~ B 
- A 
= B A 
~ A B 
~1.0+ 
- B 
-2.0+ 
$e www we mw we $ eww we ew ee $3 eo = = $ w= ee ew eee ¢--------- + 
QO. 50. 100. 150. 2 Oz S50. 


Pigure 16: REGRESSION RESULTS (DEFLATED) 
(GRAPHICAL PRESENTATION) 


Pee SUMNARY RESULTS 

Presented in this section are summary results of the 
application of the proposed methodology to a helicopter 
engine contract and to a cruise missile contract, both of 
which were 92 percent complete. 


1. Helicopter Engin 


iD 


The significant input and output data, and 
regression results are displayed in Table 11, Table 12, 


Figure 17, and Figure 18. The projected target cost, K, was 
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less than 9 percent in error after nine quarters and less 
than 3 percent in error after ten quarters. The estimate of 
next quarter's INACWP, YHAT, is closest to the actual INACWP 
in guarter ten, at a 12 percent difference. After ten 
quarters, tie the projected period in which maximum INACWP 
occurs is 4.6225, while the actual maximum occurred in 
guarter eight. An resguare value of 86.8 percent indicated 
a relatively good fit of the model to the data. As expected 
when regressing time series data, autocorrelation was 
present, thus, invalidating the use of tests for the 


Significance of the regression and regression coefficients. 
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peane cl c9 ¢14 ¢c13 c15 
INACWP 


PERIOD 


SS 0oO aN KH WM F&F Wp = 


oad 


2.60000 
2.70000 
2.50000 
3. 10000 
3.10000 
3.40000 
3.10000 
4.20000 
1.80000 
1.30000 


Table 12: 


Table 11: 


7 


2.00000 
1.35000 
0.83333 
0.77500 
0.62000 
0.56667 
0.44286 
0.52500 
0.20000 
0.13000 


pee C35 c6 c33 ¢9 629 ¢31 


PERIOD RSQUARE TARGET 
1 28.7000 
2 28.7000 
3 28.7000 
‘S 78.1000 28.7000 
3 735.9000 28.7000 
6 71.9000 28.7000 
iy 74.7000 28.7000 
8 64.8000 28.8000 
9 78.9000 28.8000 

10 86.8000 30.1000 
11 


14.3456 
18.3023 
23.0065 
26 .4437 
33.0709 
eo oo 
30.8727 
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Input Data 


TSQUARE 


1. 
4. 
oe 
16. 
25. 
36. 
49. 
64, 
81. 
100. 


INACWP 


2.60000 
2.70000 
2.50000 
3.10000 
3.10000 
3.40000 
3.10000 
4.20000 
1.80000 
1.30000 


LN ({/T) 


0.95551 

0.30010 
Ole aa ore 
-0. 25489 
-0.47804 
-0.56798 
-0.81451 
-0.644 36 
-1.60944 
-2.04022 


Output Data (Heiicopter Sngine) 


YHAT 


1.64615 
Nato 
1.97430 
1.90074 
2.29009 
1.46901 
0. 93660 


TD 


2251555 
3.11588 
3. 71135 
4.13096 
4.90290 
4.69323 
4.62250 





+--------- +--------- +--------- +--------- +--------- + PERIOD 
0.0 2.0 4.0 6.0 S010 10.0 


Figure 17: INACWP versus PERIOD (Heiicopter Engine) 


— 
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ReGRESS ¥ C15 1 C13, (C18(C19 (C20) ) ) 


THE REGRESSION EQUATION IS 


Se DE. T-RATIO 
OF COEF. COEF/S.D. 
0. 1625 Zao 
0.003228 Ses. 

LINE IS 


=SS/DF 


5.7603 
0.1095 


ST.DEV. 

PRups Y RESIDUAL 
0.160 0.611 
0.224 -0.067 


Y = 0.368 -0.0234 X1 
COLUMN COMEr. CLEN T 
X1 C13 -0.023411 
THE ST. DEV. OF Y ABOUT REGRESSION 
S = 0.3309 
WITH ( 10- 2) = 8 DEGREES OF FREEDOM 
R-SQUARED = 86.8 PERCENT 
R-SQUARED = 85.1 PERCENT, ADJUSTED FOR D.F. 
ANALYSIS OF VARIANCE 
DUE TO DF ss MS 
REGRESSION 1 5.7603 
RESIDUAL 8 0.8761 
TOTAL 9 6.6363 
X1 ¥ PRED. Y 
ROW C13 C15 VALUE 
1 1 0. 956 0.344 
10 100 -2. 040 -1.973 
Figure 18: Regression Results 


es 


(Helicopter Engine) 


Ot eon 
2-118 
=Qiia tex 





2. Cruise Missile 
A plot of INACWP versus PERIOD (Fig. 19), the input 
data (Table 13), the output data (Table 14), and the 
regression results (Pig. 20) were reviewed to summarize the 


results of applying the proposed methodology to a cruise 


missile contract. 


plot c9 vs cl 
INACWP 
20.0+ 


16.0+ a 


12.0+ 


= oD 
6 2 
oO oO 
eee vpereurbeeseeue 
* 


© 
e 
© 


0.0 3.0 6.0 9.0 12.0 15.0 
PERIOD 


Figure 19: INACWP versus PERIOD (Cruise Missile) 
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Table 13: 


INPUT DATA (Cruise Missile) 


Demme ci c9° c14 ct6 cl? 


PERIOD 


ond WM & WW RR «a 


11 
12 
13 


INACWP 


2.0000 
6.8000 
8.2000 
13.9000 
14.6000 
16.1000 
13.2000 
19.4000 
5.4000 
7.4000 
7.2000 
4.9000 
4.1000 


Y/T 


2.00000 
3.40000 
2.73333 
3.47500 
2.92000 
2.68333 
1.88571 
2.42500 
0.60000 
0.74000 
0.65455 
0.40833 
0.31538 
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PSQUARE 


1. 
4. 
9. 
16. 
25. 
36. 
49. 
64. 
81. 
100. 
121. 
T44, 
169. 


LN (Y/T) 


0.69315 
1.22377 
1.00552 
1.24559 
1.07158 
0.98706 
0.63431 
0.88583 


-0.51083 
-0.30111 
-0.42381 
-~0.89567 
- 1.15396 





Table 14: 


Pernt ¢c35 66 ¢33 c9 ¢c29 ¢31 
PERIOD RSQUARE TARGET 


Oo ON WD MN F&F WW HN aa 


ond mech eked 
= W wep —- © 


42.9000 
18.7000 

3.3000 
13.4000 
13.3000 
50.9000 
66.3000 
74.7000 
82.4000 
87.2000 


117.200 
107. 200 
110.300 
110.900 
114. 600 
114.900 
177.200 
120.900 
121.600 
128.500 
129. 300 
132.800 
132.800 


K 


~45.666 


~501.376 


300.478 
400.885 
125.780 
120.733 
1iZ2.. 099 
120.733 
12 oto 
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INACWP 


2.0000 
6.8000 
8.2000 
13.9000 
14.6000 
16.1000 
13.2000 
19.4000 
5.4000 
7.4000 
7.2000 
4.9000 
4.1000 


OUTPUT DATA (Cruise Missile) 


YHAT 


Z22eneS 
21.8928 
21.6328 
17.2160 
19.4068 
8.7810 
6.6280 
524201 
3.8867 
2.9057 


TD 


10.1015 
11.7351 
6.0634 
Brea. 
5a 9350 
9.8521 
5.8926 





Soqgaesis y cl7 1 16, (c18 (c19 (c20))) 


THE REGRESSION EQUATION IS 


Y = 1.25 -0.0144 X1 
ST. DEV. l=RALLO. = 
COLUMN COEFFICIENT OF COEF. COEF/S.D. 
=< 12515 0.1382 9.05 
X1 C16 “0.014418 Q.00 1668 -8.64 


THE ST. DEV. OF Y ABOUT REGRESSION LINE {5S 


S = 0.3238 

WITH ( 13- 2) = 11 DEGREES OF FREEDOM 
R~SQUARED = 87.2 PERCENT 

R-SQUARED = 86.0 PERCENT, ADJUSTED FOR D.F. 


ANALYSIS OF VARIANCE 


DUE TO DF ss MS=SS/DF 
REGRESSION 1 7.8312 Teeo 
RESIDUAL 11 1.1530 0.1048 
TOTAL 12 8.9842 
x1 Y PRED. Y ST.DEV. 
ROW C16 C17 VALUE PRED. Y RESIDUAL 
13 169 - 1.1540 -1.1851 0.1983 0.0311 


DURBIN-WATSON STATISTIC = 2.03 


Figure 20: REGRESSION RESULTS (Cruise Missile) 


A close look at the RSQUARE and K columns of Table 
14 indicated that the proposed model experienced a very poor 


fit to the data as well as a poor predictive ability in 
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quarters four through six. The negative K values, the very 
low RSQUARE values, and the absence of S values resulted 
from the large increases in INACWP during the first six 
quarters. Regressing Ln(y/t) on t? in quarters four through 
six yielded positive slope coefficients which in turn 
resulted in negative values of ay Since K is the product 
ep” es and the exponential of A(the intercept), and eae the 
square root of t@, ee being negative indeed causes these 
abnormal projection results (see the derivatives in Section 
C). After thirteen quarters, K differed from the actual 
TARGET value by 9 percent, YHAT differed from INACWP by 6 
percent, and t projected the maximum INACWP to occur in 
quarter 5.89, while the actual maximum occured in quarter 
eight. The RSQUARE value after thirteen quarters was 87.2 


percent. 
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VI. CONCLUSION 


A. GENERAL 


A straightforward, ees methodology was presented 
for the study of the behavior of contract costs. The 
interactive capability of MINITAB was exploited to provide a 
means of rapidly manipulating selected data (in its reported 
format, i.e.,columns) for analysis and guickly testing 
emergent hypotheses. The tools proposed, scatter plotting 
and regression, as well as the model proposed, the 
Rayleigh-Norden model, were demonstrated using actual data. 

Several relationships were hypothesized and although 
only a few contracts were suitable for application of the 
proposed methodology, the relationships were statistically 
Significant. The use of current quarterly ACWP(INACWP) and 
elapsed time (TSQUARE) were found to be good input 
parameters to the adapted Rayleigh-Norden model producing 
good predictors for total contract costs (K), and for next 
quarter's INACWP(Yhat). Resulting predictors for ty proved 
to be surprisingly poor. R-square values in all contracts 
demonstrating Rayleigh-Norden shape characteristics 


indicated close fitting of the data to the proposed model. 
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Be. SUMMARY 


The impact of uncontrolled cost growth on the 
acquisition of defense weapons systems has directed research 
effort toward gaining a clear understanding of the control 
and estimation of that cost growth. The basis for such 
understanding lies in analysis of the behavior of 
acquisition contracts, especially in aggregate at the 
systems level. 

This thesis has presented a broadly applicable and 
Simple methodology, using the interactive capability of the 
MINITAB computing system, for conducting an analysis of both 
current and deflated quarterly contract ACWP variables. 
Predictability attained through model fitting, scatter 
diagramming, and regression analysis will however, depend 
upon the availability of relevant, precisely-defined data 
accruing from standard reporting practices. 

It is the author's opinion that much of the behavior of 
contract performance and costs can be learned from existing 
data. The further application of this proposed methodology 
to a greater number and a wider variety of DOD contracts 
should increase the practitioner's knowledge of the behavior 
of contract performance and costs. A speculative assessment 


is that the behavior of performamnce and costs will be, toa 
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great extent, contractor dependent. The possible growth of 
knowledge in conjunction with a possible refinement of this 
methodology may provide cost estimators, program managers, 
and DOD decision makers a tool with which to better resolve 
+heizr ultimate management problem, i.e., the estimation and 
control of major programs. Major programs are composed of a 
multitude of contracts of the type addressed in this thesis, 
as well as many more sub-contracts, all of which require 
close monitoring if costs and schedules are to be 
controlled. The estimation and control of aggregate 


contracts are issues worthy of expanded research. 
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